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A Small-Gain Theorem for Monotone Systems 
with Multi- Valued Input-State Characteristics 

Patrick De Leenheer Michael Malisoff 

Abstract 

We provide a new global small-gain theorem for feedback interconnections of monotone input- 
output systems with multi-valued input-state characteristics. This extends a recent small-gain theorem 
of Angeli and Sontag for monotone systems with singleton-valued characteristics. We prove our theorem 
using Thieme's convergence theory for asymptotically autonomous systems. An illustrative example is 
also provided. 
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I. Introduction 

The recent extension [1] of the theory of monotone dynamical systems to monotone input- 
output (i/o) systems has proven to be very useful in analyzing the global behavior of many 
important dynamics; see for example [1], [2], [3], [4], [5], [6], and see Section HH below for the 
relevant definitions. (See also [10] for a detailed account of monotone dynamical systems.) Of 
particular interest in this literature are feedback interconnections of subsystems-or "modules"- 
that are monotone and that possess a unique globally asymptotically stable equilibrium, obviously 
depending on the particular (constant) input applied. This has lead to the introduction of the 
notion of input-state (i/s) characteristics, which are maps assigning to each constant input 
value the particular equilibrium point to which solutions converge. In many applications, this 
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assignment is exactly the type of quantitative information that is available from experiments (such 
as gene expression levels, for instance). Monotonicity, on the other hand, may be considered 
as a qualitative or structural property of an i/o system; see the graphical tests for monotonicity 
in [2] for example. These two ingredients, monotonicity of the subsystems and existence of 
characteristics, are key to proving the small-gain theorems in [1], [2], [3], [4]. (For small-gain 
theorems for nonlinear but not necessarily monotone systems, see [8].) 

In practice however, many monotone i/o systems subject to constant inputs possess several 
equilibria and all solutions converge to one of them, although distinct solutions may converge to 
distinct equilibria. Such systems are sometimes called multi-stable. In fact, since monotone i/o 
systems subject to constant inputs are monotone dynamical systems, this type of global behavior 
is to be expected (see [10]). This suggests that the notion of an i/s characteristic ought to be 
generalized to a multi-valued map which assigns to each constant input value the set of all 
possible equilibria to which solutions converge. 

This naturally leads to the question of whether the known small-gain theorem for monotone 
systems in [1] remains valid if instead of the original notion of i/s characteristics, one assumes 
the existence of multi-valued characteristics for the subsystems. The purpose of our paper is to 
show that such an extension is indeed possible. In our main result, we prove that a negative 
feedback interconnection of monotone i/o subsystems with multi-valued characteristics is itself 
multi-stable, provided that all the solutions of a particular discrete-time inclusion (which is 
typically of much lower dimension than the subsystems) converge. 

Our work provides a significant extension of the Angeli-Sontag monotone control systems the- 
ory [1] because [1] requires singleton-valued characteristics and therefore globally asymptotically 
stable equilibria. For other approaches to proving multi- stability, see [2] (where positive feedback 
interconnections of monotone i/o subsystems are considered and the trajectories converge for 
almost all initial values) and [9] (which is based on density functions and also concludes 
convergence for almost all initial values). This earlier work does not include ours because 
for example (a) our results provide global stabilization from all initial values, (b) we do not 
require any regularity such as singleton-valuedness, differentiability, or non-degeneracy for the 
i/s characteristics, and (c) our results are intrinsic in the sense that we make no use of Lyapunov 
or density functions. 

This note is organized as follows. In Section HH we provide the necessary definitions and 
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background for monotone control systems, multi-valued characteristics, weakly non-decreasing 
set- valued maps, and asymptotically autonomous systems. In Section [OH we state our small-gain 
theorem and discuss its relationship to the small-gain theorems in [1], [2], [3]. In Section ITvl 
we prove our theorem and we illustrate our theorem in Section |Vj We close in Section |VI| with 
some suggestions for future research. 

II. Background and Motivation 

A. Monotonicity and Characteristics 

We next provide the relevant definitions for monotone control systems and input-state charac- 
teristics. While our monotonicity definitions follow [1], our treatment of characteristics is novel 
because we allow discontinuous multi-valued characteristics and unstable equilibria. Our general 
setting is that of an input-output (i/o) system 

x — f(x,u), y = h(x), x <E X, u eU, y E y (1) 

where X C W 1 is the closure of its interior and partially ordered, hi and y are subsets of partially 
ordered Euclidean spaces By and By respectively, and / and h are locally Lipschitz on some 
open set X containing X. We refer to X as the state space of (HJ), hi as its input space, and y 
as its output space. In general, X will not be a linear space, since for example we often take 
X = R> := {x E W 1 : Xi > OVi}. We use ^ to denote the partial orders on all our spaces, 
bearing in mind that the partial orders on our various spaces could differ. 

The set of control functions (also called inputs) for ([T]), which we denote by Uoo, consists 
of all locally essentially bounded Lebesgue measurable functions u : R — > hi, and we let 
t i — > 4>(t,x , u) denote the trajectory of © for any given initial value x a G X and u G hi^. 
We always assume our dynamics / are forward complete and X-invariant, which means that 
x a , u) is defined on [0, oo) and valued in X for all x a G X and u G U^. Since we will be 
considering more than one dynamic, we often use sub- or superscripts to emphasize the state 
space variable or dynamic, so for example $ is the flow map for the dynamic / and y z is the 
output space for an i/o system with state variable z. 

We always assume that our partial orders -< are induced by distinguished closed nonempty 
sets K (called ordering cones) and we sometimes write Ku to indicate the cone inducing the 
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partial order on the input space U and similarly for the other partial orders. We always assume 
K is a pointed convex cone, meaning, 

aK C K Va > 0, K + K C K, Kf](-K) = {0}. 

When we say that a cone K induces a partial order -<, we mean the following: x -< y if and only 
if y — x E K. This induces a partial order on the set of control functions U.^ as follows: u -< v 
if and only if u(£) ^ v(£) for Lebesgue almost all (a.a) t > 0. A function g mapping a partially 
ordered space into another partially ordered space is called monotone provided: x -< y implies 
g(x) d g(y)- We say that (HJ is single-input single-output (SISO) provided B u = By = M, taken 
with the usual order, i.e., the order induced by the cone K = [0, oo). 
Definition 2.1: We say that ([T]) is monotone provided h is monotone and 

(p r< g and u ^ v) =>- (<j>(t,p, u) ^ 0(t, g, v) Vt > 0) 

holds for all p,q E X and u, v 6 W^. 

We let Equil(/) denote the set of all equilibrium pairs for our dynamic /, namely, the set of 
all input-state pairs (u, x) such that f(x,u) = 0. For each (u,x) G Equil(/), we let T>f(u,x) 
denote the domain of attraction of x = f(x,u) to x, namely, the set of all p E X for which 
4>(t,p,u) — >• x as t — > +oo, where is the flow map for /. Since we are not assuming our 
equilibria are stable, the sets V^(u,x) are not necessarily open and could even be singletons; 
see below for an example where V^(u,x) is not open. Given (u, x) € Equil(/), we say that / 
is static Lyapunov stable at (u,x) provided the following condition holds for all e > 0: There 
exists 5 = 5(u, x, e) > such that for all x a G T>f(u, x) fl Bg(x)(— radius 5 open ball centered 
at x), we have \4>{t, x Q , u) — x\ < e for all t > 0. 

Recall the following notions from [12], in which we let f u denote the constant input system 
/(■, u) for each u ElA. Given u e U, we say that two nonempty (but not necessarily distinct) sets 
M\, M 2 ^ X are f u -chained provided there exists a value y E X \ (Mi U M 2 ) and a trajectory 
x : R — > for / n satisfying x(0) = ?/ whose a-limit set a(x) := (~]{x((— oo, — t]) : t > 0} 
lies in Mi and whose uj-limit set cu(x) := f"|{x([t, +oo)) : t > 0} lies in M 2 . We say that a 
finite collection of nonempty sets Mi, M 2 , . . . , M r C X is f u -cyclically chained provided the 
following holds: If r = 1, then M x is /"-chained to itself; and if r > 1, then Mj is /"-chained to 
Mj + i for i — 1, 2, . . . , r — 1 and M r is /"-chained to Mi. In this case, we call {Mi} an f u -cycle. 
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An f u -equilibrium is defined to be any point x E X such that f(x,u) = 0. A set M C X is 
called f u -invariant provided the flow map <p for / satisfies M = {(f)(t,x,u) : t > 0, x E M}. 
A compact /"-invariant set M C X is called f u -isolated compact invariant provided there 
exists an open set U C ^ such that there is no compact /"-invariant subset M C X satisfying 
M EL M EL U. except M. We use the symbol =4 to denote a set-valued map (also called a 
multifunction), e.g., F : =^ Z 2 means that F assigns each p E Z\ a nonempty set -F(p) C Z 2 . 

Definition 2.2: We say that © is endowed with a static input-state (i/s) characteristic k x : 
U ^ X provided: 

1) Graph^) = Equil(/); 

2) U{X? / (w,S) : x E k x (u)} = X for all u EU\ 

3) / is static Lyapunov stable at each (u,x) E Equil(/); and 

4) For each uEU, k x (u) consists of /"-isolated compact invariant /"-equilibria and contains 
no /"-cycles. 

In this case, we also call k y := ho k x an input-output (i/o) characteristic for 

This definition reduces to the usual singleton- valued i/s characteristic definition in [1] when 
C&rd{k x (u)} = 1 for all u E U. We will not use the static Lyapunov stability property in the 
proof of our small-gain theorem per se, but we still include it to make our definition of i/s 
characteristics include the singleton- valued characteristic definition in [1]. Condition 3 in our 
definition is not implied by the other conditions in the definition, even if / has no controls, 
since it is well-known that / could admit an unstable globally attractive equilibrium; see for 
example [7, pp. 191-4]. Condition 2 in the definition says for each u Eti and each initial state, 
the corresponding /"-trajectory asymptotically approaches some state x E k x (u) (where x can 
in principle depend on the initial state of the trajectory). The stipulation in the static Lyapunov 
stability definition that x Q E T>f(u,x) fl Bg(x) is motivated by the fact that our domains of 
attraction T>f(u, x) may or may not be open, even if there are no controls. Condition 4 is needed 
to apply the theory of asymptotically autonomous systems; see Section III-CI for the relevant 
definitions and details. 

Remark: Condition 4, and in particular the "no cycles" part, may be hard to check in practice, 
at least if the system dimension is higher than 2, but can often be checked using monotonicity 
arguments. Consider for instance a monotone system x = f(x) having two /-isolated compact 
invariant equilibria p and q and assume that p -<-< q (where the latter means that q — p 
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belongs to the interior of the order cone K, which is assumed to be nonempty). Then there 
exist neighborhoods N p and N g of p and q respectively such that n p -<-< n q for all n p £ N p 
and n q £ N q . We show that {p, q] cannot be an /-cycle. Suppose it was a cycle. Then there 
exist points y and z such that a(y) = {p}, uj(y) = {q} and a(z) = {q}, uj(z) = {p}. It 
follows in particular that there exists T > large enough such that n p := (p(—T,y) £ N p and 
n q := (f)(—T, z) £ N q . Consider the strictly ordered initial conditions n p -<-< n q for the monotone 
system x = f(x). Since cu(n p ) = {q} and u(n q ) = {p}, there exists T > large enough so 
that (j}(T,n p ) £ N q and (f)(T,n q ) £ N p and thus (f)(T,n q ) -<-< (p(T,n p ), which contradicts 
monotonicity of the system. The same argument can be used to rule out cycles containing more 
than two equilibria, if we assume that the equilibria are totally ordered by -<-< (that is, either 
p -<!-< q or q -<-< p whenever p and q are distinct equilibria). 

B. Weakly Non-Decreasing Set-Valued Maps 

A basic property of singleton-valued i/s characteristics k x is that they are non-decreasing in 
the relevant partial orders, in the sense that the following holds for all u, v £ U x : u -< v implies 
k x (u) k x (v); see [1] for the elementary proof. It is therefore natural to inquire about whether 
set-valued i/s characteristics posses some analogous (but more general) order-preserving property. 
This motivates the following definition and lemma: 

Definition 2.3: Let Z\ and Z 2 be partially ordered Euclidean spaces and F : Z\ =4 Zi be 
any set-valued map. We say that F is weakly non-decreasing provided the following holds for 
all p, q £ Z\ such that p -< q: For each k p £ F(p) and k q £ F(q), there exist r p £ F(p) and 
r q £ F(q) such that r p ■< k q and k p -< r q . 

Lemma 2.4: If k x is an i/s characteristic for ([Hi and (HJ) is monotone, then k x is weakly 
non-decreasing. 

Proof: Let p,q £ U x be such that p ■< q, let k p £ k x (p) and k q £ k x (q), and let denote 
the flow map of /. The corresponding trajectories for the constant inputs satisfy (p(t,k q ,p) ^ 
k q , q) = k q for all t > 0, and fc g ,p) — > r p for some r p £ ^(p) as t — > +oo, so r p ^ fc 9 
follows because ordering cones are closed. The other order inequality is proved similarly. ■ 
Definition 12 . 3l reduces to non-decreasingness in the relevant orders when F is singleton-valued. 
We are especially interested in solution sequences Wk satisfying discrete set-valued inclusions 
Wk+i £ F(wk) for all k £ N where F is weakly non-decreasing. To further motivate our study of 
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weakly non-decreasing multif unctions, let us first assume that F : [0, 1] — > [0, 1] is a singleton- 
valued and non-decreasing map in the usual orders (that is, F(x) < F(y) when x < y). Then it 
is obvious that every solution of Xk+i = F(xk) converges. Indeed, either xq < F(xq) and then 
%o < -^(^o) — F 2 ( x o) < • • • < F k (xo) for all k E N, so the sequence {F fe (xo)} must converge 
since it is bounded above by 1; or else F(x ) < x , which leads to a non-increasing sequence 
{F k (xo)}. That converges as well since it is bounded below by 0. On the other hand, this simple 
dynamical behavior will not occur in general for multi-valued, weakly non-decreasing maps. 

To see why, consider the following simple example. Assume that F : [0, 1] =4 [0, 1] is a multi- 
valued map whose graph consists of the union of three straight line segments: one connecting 
A = (0, 0) with B = (1/2, 1/4), a second connecting B to C = (1/4, 1/2) (of slope -1), and a 
third connecting C with D = (1, 1). This "inverted Zorro map" is illustrated in Figure [l] below 
and is weakly non-decreasing in the usual orders. Then the inclusion Xk+i E F(xk) has periodic 
points of period 2. For instance, the periodic sequence {1/2, 1/4, 1/2, 1/4,...} is a solution of 
the inclusion. In fact, to every initial condition x E [1/4, 1/2] corresponds a periodic sequence 
of period 2 satisfying the inclusion, namely {x , 3/4 — x , x , 3/4 — x , ...} (since 3/4 — a; E F(x) 
for all x E [1/4, 1/2]). 

These periodic sequences are caused by the fact that the slope of the middle line segment of 
the graph of F is —1. Any slight decrease of this slope will destroy the periodic points and leads 
to solutions that converge to one of the fixed points. For example, for arbitrary e > we can 
define F e as the map whose graph consists of three straight line segments connecting A to B, B 
to E = ((1 + 2e)/(4 + 4e), 1/2) (so the slope of this line segment is -1 - e), and E to D. Then 
every solution of the inclusion Xk+i E F e (xk) will converge to one of the three fixed points of F. 
In fact, each solution sequence of this inclusion converges to either or 1, except for the constant 
sequence at the middle fixed point x = (3 + 2e)/ (4(2 + e)). To see why, notice that if x Q > 1/2, 
then (xfc, F t (xk)) remains on the segment ED, so Xk | 1 by the argument for the singleton-valued 
case. Similarly, if x a < (l + 2e)/(4+4e), then (x fc , F e (xk)) remains on AB so Xk | again by the 
singleton- valued case; while if Xk stays in [(l + 2e)/(4 + 4e), 1/2], then Xk+i = — (l+e^ + f+l 
for all k. Then either Xk = x, or else \xk+i — Xk\ = (1 + e) h \xi — x \ — > +oo as k — > +oo which 
is impossible. Therefore, either x^ stays at x, or else x k exits [(1 + 2e)/(4 + 4e), 1/2] and then 
converges to either or 1, as claimed. 
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Fig. 1. The inverted Zorro map F (ABCD) and its perturbation F f with e = 1.5 (ABED) from Section Hl-BI 

C. Asymptotically Autonomous Systems 

We will be especially interested in dynamics for which the asymptotic behavior under constant 
inputs is known. We will then obtain information about the trajectories for not-necessarily 
constant inputs using the theory of asymptotically autonomous systems. Before turning to this 
theory, first recall the following "Converging-Input Converging-State" (CICS) Property. This 
property was shown in [11] and was used in [1] to study the stability of interconnected monotone 
systems. We use the CICS property at the very end of the proof of our main result (on pfT3l). 

Lemma 2.5: Let u E U, and let x be an asymptotically stable equilibrium point for f u . Let 
/C be a compact subset of T>f (u, x). If x : [0, oo) — > X is a /C -recurrent trajectory of / for some 
continuous input u : [0, oo) — > U, and if u{t) — > u as t — ► +oo, then x(t) — ► x as t — > +oo. 
Here JC -recurrent means for each T > 0, there exists t > T such that x(t) E JC. One of 
the requirements of asymptotic stability of x (in addition to the convergence condition) is the 
following stability property: For each e > 0, there exists 5 > such that | </>(£, £, u) — x\ < e for 
all £ G £><5(x) and t > 0. The proof of the CICS property in [11] uses the fact that T>f(u, x) is 
open, which follows from the assumption that x is a stable equilibrium. 

However, in our more general setting where the i/s characteristics are multi-valued, the domains 
of attraction will not necessarily be open, so the CICS property does not apply. Instead, we prove 
our result using the theory of asymptotically autonomous systems developed by Thieme in [12]. 
To this end, we first note that Condition 2 from our definition of i/s characteristics implies the 
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following equilibrium condition (EC) from [12]: 

(EC) For each u EU, the cu-limit set of any pre-compact /"-trajectory on [0, oo) consists of 
an /"-equilibrium. 

By an asymptotically autonomous system, we mean a system x = H(t, x) that admits a second 
dynamic x = H(x) (called a limiting dynamic) such that H(t,x) — > H(x) as t — ► +oo locally 
uniformly in x. For example, if u G is continuous and u G W is such that u(t) — ► u as 
i — >■ +oo, then for our locally Lipschitz dynamic /, we know x = H(t,x) := f(x,u(t)) is 
asymptotically autonomous with limiting dynamic x = H(x) := f(x, u). Using this observation, 
the following is then immediate from [12, Corollary 4.3] and our i/s characteristic definition: 

Lemma 2.6: Assume © is endowed with an i/s characteristic. Let u ElA and u : [0, oo) — > U 
be any locally Lipschitz function for which u{t) — > u as t — ► +oo. Let a; : [0, oo) — >• X be any 
bounded trajectory for ([Hi and this input u(t). Then converges towards an /"-equilibrium 
as t — > +oo. 

If one drops the "no cycle" part of condition 4 in Definition 12.21 then the conclusion of the 
above Lemma does not necessarily hold; see [12] for an example. 

III. Statement and Discussion of Small-Gain Theorem 

We turn next to our small-gain theorem, which generalizes [1, Theorem 3]. The main novelty 
of our result lies in its applicability to cases where one of the interconnected systems has a multi- 
valued i/s characteristic, but see Remark |3] below for a further extension for cases where both 
subsystems have multi-valued i/s characteristics. In what follows, an equilibrium of a discrete 
inclusion Wk+i G F(wk) is defined to be any value w such that w G F(w); the set of all equilibria 
for this inclusion is denoted by £(F). A multi-function F is called locally bounded provided it 
maps bounded sets into bounded sets. We say that a continuous time dynamics F has a pointwise 
globally attractive set S provided each maximal trajectory for F asymptotically approaches 
some point in S (which could in principle depend on the specific trajectory) as t — > +oo. 

Theorem 1: Consider the following interconnection of two SISO dynamic systems: 

x = f x (x,w), y = h x (x) 
z = ft(z,v), w = h z (z) 
with IA X = y z and U z = y x . Assume the following: 
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1) The first system is monotone when its input w and output y are ordered by the "standard 
order" induced by the positive real semi-axis. 

2) The second system is monotone when its input y is ordered by the standard order and its 
output w is ordered by the opposite order (induced by the negative real semi-axis). 

3) The respective static i/s characteristics k x and k z exist with k x singleton- valued and k z 
locally bounded. 

4) Each trajectory of is bounded; and each solution sequence {t> fc } of t> fc+1 G (k y ok w )(vk) 
converges. 

Then has the pointwise globally attractive set Li{{k x (w)} x (k z o k y )(w) : w G £{k w o k y )}. 
In this setting, k y = h x o k x and k w = h z o k z . 

Our theorem differs from the small-gain theorem [1, Theorem 3] mainly in that (a) we replaced 
the single valuedness of k z with local boundedness of k z , (b) we replaced the discrete system 
Wk+i = (k w ok y )(wk) from [1] with a discrete inclusion, and (c) we conclude that is attracted 
to a set of equilibrium points rather than a single point as in [1]. Moreover, in contrast to [2], 
our theorem gives global convergence of the interconnection from all initial values. 

Remark 2: Assumption 4 of our theorem is equivalent to the following: 4'. Each trajectory of 
is bounded; and {k y (wk)} converges for each solution sequence {wk} ofwk+i G (k w ok y )(wk)- 
In fact, if Assumption 4 holds and Wk is any solution of Wk+i G (k w o k y ){wk), then k y {wk) 
converges because Vk = k y (wk) is a solution sequence for Vk+i G (ky o k w )(vk). Conversely, if 
Assumption 4' holds, and if Vj~ is any solution sequence of Vk+i G (k y o k w )(vk), then we can 
inductively find a new sequence rk such that Vk+i = k y (rk) and r^+i G (k w o k y )(rk) for all k, 
so Vk converges. On the other hand, it could be that Assumption 4 holds but that there exists a 
divergent sequence Wk for Wk+i G (k w ok y )(wk). See Remark|4lfor an example where this occurs. 
However, if the trajectories of are bounded, and if each solution of Wk+i G (k w o k y )(wk) 
converges, then Assumption 4' (or equivalently Assumption 4) holds because k y is continuous 
(by the arguments from [1, Proposition V.5] and our assumption that k x is singleton valued). 

IV. Proof of Small-Gain Theorem 

The following key lemma generalizes [1, Proposition V.8] to systems with multi- valued 
characteristics. In it, we set um := lim inf t_» +00 u(t) and u sup := lim sup t _ >+00 u(t) for any 
continuous scalar function u on [0, oo). 
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Lemma 4.1: Under the hypotheses of Theorem [H if (x(t),z(t)) is any trajectory of © and 
C G oj(z), then there exist k_ E k z (y- mi ) and k + E k z (y sup ) such that /c_ ^ C ^ 

Proof: We only prove the existence of A;_ since the proof of the existence of k + is similar. 
Set p, = yinf and let £ be the initial value for z(t). Let i, — > +00 and /z.,- — > /x be sequences such 
that /ij G Z4 and > //j for all t > tj and all j. We have the following for all t > tj and 
jEN: 

z{t) = (j)(t,^,y) = (f)(t-t j ,(f)(t j ,£,y),y(- + t j )) y <p{t - tj, (j)(tj, £, y), pj), (3) 

where <\> is the flow map for f z and the last order inequality follows from the monotonicity of 
the ^-subsystem. Therefore, if z(s{) — > ( for some sequence si — > +00, then we can set t = S[ 
in © and use the closedness of order cones to find values Vj E k z (fj,j) such that 

C h Km - t i; e, y), = Vj G N. (4) 

t— >oo 

Since is assumed to be locally bounded and has a closed graph (by the continuity of the 
dynamic f z in all arguments), we can find fc_ G such that ( >z vj — * possibly by 

passing to a subsequence without relabelling. This proves the desired inequality. ■ 
Returning to the proof of our small-gain theorem, notice that since the output w is ordered by 
the negative real semi-axis, and since k z is weakly non-decreasing (by Lemma 12.4b . it follows 
that 

max min (k p — k q ){p — q) < Vp, q E U z . (5) 

In other words, for each p,q ElA z and k p E k w (p), we can find k q E k w (q), such that k p — k q and 
p—q have opposite signs. Also, k y is continuous and non-decreasing, as shown in [1, Propositions 
V.5 and V.8] and Lemma 12.41 Choose any initial value £ for the interconnection ©, and let 
(x(t),z(t)) denote the corresponding trajectory for © starting at £. This trajectory is defined 
on [0, 00) since we are assuming our trajectories are bounded. Set w + = w sup , w_ = w in f, and 
similarly define y±. Let z + (resp., zJ) E lo(z) be such that w_ = h z (z + ) (resp., w + = h z (zJ)). 
These limits exist because h z is continuous and z{t) is bounded in the closed set X z . By Lemma 
14.11 we can find k + E k z (y + ) and G k z (yJ) such that -< z- and z + -< k + . Setting 
r+ 5 = hg(k+) and = h z (k_) and recalling that w reverses order gives 

k w (y + ) 3 r ( ° } <w_<w + < r M E k w (y_). (6) 
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Since we are assuming k x is singleton- valued, the proof of [1, Theorem 3] gives 

k y (w_) < y- < y+ < k y ( w +)- ( ? ) 

Combining © and © and recalling that k y is non-decreasing gives 

(k y ok w )(y+) 3 k y (r° + ) =: < k y (w_) < y_ (8) 

< V+ < k y (w + ) < s w := k y (r { ° ] ) G (k y ok w )(yJ). 

In summary, 

{k y ok w ){y + )3 s { l ] < y- < y + < s w G (k y o k w )(y_). (9) 

Since y + < s w and r+ 5 G k w (y + ), we can use © to find r+ 5 G k w (s w ) C fc^A^ o k w )(yJ) 
such that < r+\ Since fc y is non-decreasing, © therefore gives 

2/- > k y (rf) > k y (r^)=:s^E(k y ok w Y(y^. (10) 

Similarly, since y_ > s+ and r_ G k w (yJ), we can use © to find r_ G C A^A^ o 

k w )(y + ) such that r^' < r w . Hence, © also gives 

y + < k y (r m ) < k v {r l l ) )=:sfe(k v ok w )\y+). (11) 
Combining (fill and (fTTT) gives 

(k y ok w y(y„) 3 a™ < y- < y+ < sf e (k y o k w ) 2 (y + ). 

Recalling © and proceeding inductively gives sequences {s±'} satisfying the following for all 

JEN: 

{k y ok w y i {yJ)3s ( l i) < y- < y + < e (k y o k w ) 2J (y+) (12) 
{kyOk w )*-\y + )3s% i - 1) < y- < y + < s^ _1) G (ky o k w f i ~ 1 (y-). (13) 

Notice that 

s£ G (A^cA^T 1 ^) Vj GN. (14) 

Therefore, Assumption 4 from our theorem provides f± such that s± — >■ f± as j — >■ +oo. 
Letting j — > +oo in (fT2T) shows that f_ < f + . On the other hand, letting j — > +oo in (fT3l gives 
f + < f_. Thus, 

r+ = f_ = y+ = y- =: y. 
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Applying Lemma I2T61 to the z-subsystem f = f z and the input u(t) = y(t) — ► y shows that 
z(t) — > z for some 2 e k z (y). Since /i 2 is continuous, converges as well; i.e., u> + = u>_ =: 
u). Therefore, = h z (z) E k w (y) and © gives y = k y {w). It follows that w E (k w o k y )(w), so 
w E £(k w o k y ). Therefore, our theorem will follow once we show that (x(t), z(t)) converges to 
some point in {k x (w)} x [k z o k y )(w) as t — > +00. To this end, first note that x(t) — > k x (w) 
as t — > +00 as a consequence of the CICS property (namely Lemma 12.51 above) applied to 
the x-subsystem f = f x and the input u(t) = w(t) — > w, because we are assuming that k x is 
singleton-valued. Since z E k z (y) = k z (k y (w)), this completes the proof of the theorem. 

Remark 3: One can extend our theorem to cases where k x and k z are both multi-valued. For 
example, our theorem remains true if we replace its Assumption 3 by: 
3'. The respective i/s characteristics k x and k z exist and are locally bounded. 
In this case the conclusion of the theorem is that our interconnection has the pointwise 
globally attractive set U{k x (w) x [k z o k y ){w) : w E £(k w o k y )}. The proof of this alternative 
formulation is similar to the proof we gave above and proceeds by a repeated application of 

min max (k p — k g )(p — q) > Vp, q E U x . (15) 

Condition (TTSt follows because h x is monotone and k x is weakly non-decreasing. We leave the 
details of the proof of this more general version of our theorem to the reader. 

V. Illustration 
We next illustrate our theorem using the interconnection 

x = —x + 5 + w, y = x 

(16) 

z = -P(z)+y, w = 

evolving on [0, 00) x [0, 00), where P(z) = z(2z 2 — 9z + 12). We order x and z by the usual 
cone [0, 00). This dynamic satisfies Conditions 1-2 from Theorem [lj Replacing w with in 
([TBI) gives the planar positive feedback system 

x = — x "I - 5 "I - ~r~. — 7 , y — x 

1+w 2 ' y (17) 

z = —P(z) + y, w = z. 
If we use superscripts o to label the characteristics of our original interconnection (fTBI) . and if 
we use k x and so on to denote the characteristics of (fTTt . then k° ( 1 1 2 ) = k x (w) and k° = k z . 
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Also, if u k+ i G ° k°)(uk) with u k > for all fc, then Wk+i G o k y )(wk) for all fc when 
the u^'s are chosen to satisfy 

1 

for all k G N. Moreover, since the output u> in (fToT) is always positive, o k°)(0) C (0, oo), 
so «fc > for all > 1 along all solution sequences of u k+1 G (A;° o fc°)(w fc ). Therefore, if 
each solution sequence {wk} for u^+i G (k w o k y ){wk) converges, then each solution sequence 
{u^ for Uk+i G o k°)(uk) converges as well, which implies the required convergence of 
solutions of Vk+i G (k° o k° w )(ffc) by Remark El The fact that Condition 3 will also hold for the 
original interconnection (TToT) will then follow because (fToT) has the same trajectories as (fT71) . 

It therefore remains to show that (fTTt satisfies Condition 3 from our theorem, that all its 
trajectories are bounded, and that each solution of Wk+i G (k w o k y )(wk) converges. To this 
end, first note that since the outputs of both subsystems in (fTTl) are also their states, i/s and i/o 
characteristics coincide for (flTt -if they exist-so we can define 

k\ — k x = ky } k2 — k z = k w 

wherever the characteristics exist. The characteristic of the first subsystem in (fTTt is the singleton- 
valued function 

hiw) = 5+ 1 w G R+, 
1 + 

while the characteristic for the second subsystem is multi-valued and only determined implicitly 
as follows: k 2 (y) = {z G R : -P(^) = for y G K+. A bifurcation analysis of the scalar system 
z = —P(z) +y, treating y G IR+ as a bifurcation parameter, shows that k 2 (y) is a characteristic 
which is 

1) single-valued if y G [0,4) or if y G (5, oo). 

2) triple- valued if y G (4,5). 

3) double-valued if y = 4 or 5: fc 2 (4) = {1/2, 2} and jfe 2 (5) = {1, 5/2}. 

There are two saddle-node bifurcations, one at y = 4 and the other at y — 5. The four defining 
properties of a characteristic (see Definition 12 .21) can indeed be readily verified: For each y G M+, 
the system z = —P(z) + y has a finite number of isolated compact equilibria and no cycles 
(since the system is scalar), and every solution converges to one of the equilibria. It is also not 



February 1, 2008 



DRAFT 



15 



hard to see that k 2 is locally bounded. In order to apply Theorem [lj we only need to verify that 
(fTTt satisfies Condition 4 of our theorem. 

To check that the trajectories of (fTTt (or equivalently of (O) are bounded, it suffices to 
verify the following: Claim (G): If (x(t), z(t)) is any trajectory of (1761) defined on some interval 
[0, T], then there is a compact set D depending only on (x(0),z(0)) (and not on T) such that 
(x(t),z(t)) G D for all t G [0, T\. Boundedness will follow from (G) by standard results for 
extendability of solutions of ODE's. To prove (G), first note that the boundedness of w on [0, T] 
and the variations of parameters formula gives 

\y(t)\ = \x{t)\ < \x(0)\ + 6 

for all t G [0,T]. Pick z > 5/2 such that z = P~ 1 (|x(0)| + 6) which exists because P is 
one-to-one above 5/2. It follows that if t G [0,T) is such that z[t) > z, then 

(z(t))>P{z) = \x(0)\+6>y{t), 

so z(t) < 0. Therefore, z(t) stays below z on [0,T]. Since z depends only on x(0), Claim (G) 
follows. 

Next consider the discrete inclusion Wk+i G (k 2 o k\) (wk) and notice that it reduces to a 
discrete equation w k +i = (k 2 ok 1 ) (w k ) because ki(w) > 5 and k 2 (y) is single-valued when 
y > 5. Notice also that for all u>o G M+, the discrete equation gives w k > 5/2 for all k > 1. 
In particular, the interval (5/2, oo) is forward invariant for the discrete equation. Finally, since 
|&i(u>)| is decreasing for w > 5/2, elementary calculus shows that 

\k'(kUw))k'(w)\ < lk[{5/2)l < '^ (5/2)l - 5 2 < 1 Vw >5/2 

IWil^iWI < P , {k2okl{w)) ^ p/( 5/2 ) " (1 + 25/4)2 9 < Vu '^ 5 / 2 ' 

so k 2 oki is a contraction mapping on [5/2, oo), hence the discrete equation has a unique globally 
attractive fixed point w. Therefore, we know from Remark El that (TPTb satisfies Conditions 3-4 
of our theorem, as claimed. Since 

£(k° w ok° y ) = \—±— 2 :we£(k 2 ok 1 ) 
y [ 1 + w z 

we conclude that our original interconnection (fT6l) has the unique globally attractive equilibrium 

5+ -r—7;,k ' " ' 



1 + w 2 ' V 1 + w 2 



Figure 13 below illustrates this. 
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u 0.5 1 1.5 2 2.5 3 3.5 

w 

Fig. 2. Characteristics ki(w), kz{y) and R(w) from Section fvl 

Remark 4: In the preceding example, the inclusion w k+ i E (k w ° k y )(wk) had a unique 
equilibrium, but our theory applies to examples where £(k w o k y ) has more than one element as 
well. One such example is constructed by modifying the interconnection (fT7l in the following 
way: replace the z-subsystem with x = — x + R(w) where R consists of the line segments 
in the wy-plane joining (0,5) to (.5,4.5), (.5,4.5) to (2.5,4.5), and (2.5,4.5) to (3.5,3). With 
this change we get Card{£ (k w o k y )} = 3, and the conclusion of our theorem remains true 
because {k y (w k )} converges for each solution sequence {w k } of w k+1 E (k w o k y ){wk)\ see 
Remark |2| In fact, if w a E [.5,2.5], then k y (w ) = 4.5, so w k E £(k w o k y ) for all k E N, 
which gives k y (wk) = 4.5 for all k E N. If w Q E [0, .5], then k y (w ) E [4.5,5], which gives 
Wi E [.5, 2.5], so k y (wk) = 4.5 for all k > 2 as before. Finally, if w Q > 5/2, then k y (w ) < 4.5, 
so wi E k w o k y (w ) E [0,5/2], so k y (w k ) = 4.5 for k > 3, by the previous two cases. On 
the other hand, one can find non-periodic divergent solution sequences of w k +i E (k w o k y ){w k ) 
when w Q E [1/2,5/2]. The detailed analysis of this more complicated example is similar to 
the analysis of (fT7t and is left to the reader. Note that the convergence of the iterations in the 
preceding remark follows because R(w) is a horizontal line, at least locally where it meets the 
other characteristic. 
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VI. Conclusion 

We presented a new small-gain theorem for interconnections of monotone i/o systems with 
set- valued i/s characteristics. This corresponds to situations where the trajectory for a given 
constant input can converge to several possible equilibria, depending on the initial value for the 
trajectory. A key ingredient in the proof of our small-gain theorem is the theory of asymptotically 
autonomous systems, which requires in particular that the equilibria of the subsystems in the 
interconnection contain no chains. This suggests the question of how one might extend our 
theory to cases where the sets of equilibria of the subsystems are more general, e.g., where they 
contain chains or limit cycles. Research on this question is ongoing. 
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